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AND SUB-PIXEL GEOMETRY 

BACKGROUND OF THE INVENTION 
The present invention relates to device-specific information for pixels. 
Color in computer graphics is defined in terms of "color spaces", which are 
related to real or imaginary color display devices such as monitors, liquid crystal displays 
and color printers. Various color spaces are used to represent color on computers. Each 
image is associated with a color space which defines colors according to a combination of 
properties. For example, in a RGB (Red, Green, Blue) color space, each color is 
represented by a combination of red, green and blue components. In a CMYK (Cyan, 
Magenta, Yellow, Black) color space, each color is represented as a combination of cyan, 
magenta, yellow and black. 

An output display device such as a computer monitor, liquid crystal display 
(LCD) or printer is capable of reproducing a limited range of colors. An output display 
device's "color gamut" is the set of colors that the output display device is capable of 
reproducing. Similarly, the "visible color gamut" is the set of colors that the human eye 
is capable of perceiving. Color gamuts can be represented as a two-dimensional 
projection of their three-dimensional representations onto the plane of constant 
luminance. 

Typically, color display devices are constructed from an array of pixels that 
are themselves composed of several (typically three) differently colored components or 
sub-pixels. The input values of these sub-pixels may be varied from full off to full on to 
cause the output display device to display the pixels at visual output intensities 
corresponding to the pixel input values. The perceived color of each pixel is the 
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aggregate of the visual output intensities and colors of its sub-pixels. Thus, a pixel can 
take a range of values through the color spectrum by varying the input values of its sub- 
pixels. 

A pixel's color is generally represented by a series of bits (the "color value"), 
with specific bits indicating a visual output intensity for each sub-pixel used in the color. 
The specific sub-pixels depend on the color system used. Thus, a 24-bit RGB data 
representation may allocate bits 0-7 to indicate the amount of blue, bits 8-15 to indicate 
the amount of green, and bits 16-23 to indicate the amount of red, as shown in FIG. 3. 
Such a representation can produce any one of nearly 17 million different pixel colors (i.e., 
the number of unique combinations of 256 input values of red, green, and blue). By 
contrast, systems that allocate fewer bits of memory to storing color data can produce 
only images having a limited number of colors. For example, an 8-bit color image can 
include only 256 different colors. 

On a color display device such as an LCD screen with a horizontal resolution 
of 800 pixels, the LCD screen can actually be composed of 800 red, 800 green, and 800 
blue sub-pixels interleaved together (R-G-B-R-G-B-R-G-B ...) to form a linear array of 
2400 single-color sub-pixels. Each sub-pixel is independently addressable, that is a color 
value can be set for each individual sub-pixel of the color display device. While each of 
the sub-pixels is individually addressable, the human eye sees (visible color gamut) a 
blending of the sub-pixels. For example, a single pixel wide white line can be produced 
by setting the input values of all sub-pixels for a row or column of pixels to a maximum 
value. The human eye does not 'see' closely spaced colors individually, and as such, 
cannot distinguish the individual color components. Instead, our vision system 
deliberately mixes the colors in combination to form intermediates, in this case the color 
white. 

To display a fine structure monochrome image with fine detail such as black 
text on a white background or white text on a black background on a color display device 



or a monochrome display device, special attention must be paid to the visual output 
intensity of each sub-pixel in order to reduce color fringing effects. Unfortunately, 
device-specific pixel information that look good when used in displaying the text on one 
type of output display device may show color fringing effects when used in conjunction 
with other types of output display devices. 

Color display devices may be constructed using different geometries of 
colored sub-pixels associated with each pixel. Depending on the color display device, 
different sub-pixel geometries result in various degrees of color fringing of monochrome 
images. Not all LCD screens, for example, have the same linear ordering of sub-pixels, 
for example a R-G-B ordering for a RGB color space type of output device. Other 
possible orderings include R-B-G, B-G-R, B-R-G, G-B-R and G-R-B. When two sets of 
images, one produced on an LCD device having a R-G-B sub-pixel geometry and the 
other produced on an LCD device having a B-G-R sub-pixel geometry such that neither 
LCD device displays color fringing, are displayed on a third LCD device having a R-G-B 
sub-pixel geometry , only the set of images with R-G-B ordering will appear without 
color-fringing. The set of images with B-G-R ordering will appear color-fringed. It 
would therefore be an advantage if the sub-pixel geometry for all pixel of an output 
device could be determined prior to display of an image so as to minimize the effect of 
color fringing. 

For a given color display device, to minimize color fringing of finely detailed 
monochrome images, the proper intensity settings for each of the sub-pixels that make up 
a pixel as well as the sub-pixel geometry must be found. 

SUMMARY OF THE INVENTION 
The invention provides a method for determining device-specific information 
for pixels to obtain an optimal display of fine structure monochrome images on an output 
display device. 



In one aspect, the invention provides a method for determining a set of device- 
specific pixel input values that will cause the display system to display a corresponding 
set of target output intensities relative to the output display device. The method includes 
obtaining a target visual output intensity, establishing a reference region in a display 
device, selecting a pixel input value for each of the reference pixels, displaying the 
reference region with the selected pixel input values for the reference pixels, displaying a 
control region on the display device, adjusting the common pixel input value in response 
to user input, and associating the common pixel input value with the target visual output 
intensity when a user input indicates a match between the appearance of the reference 
region and the appearance of the control region. The invention further provides a 
method for determining a device-specific sub-pixel geometry for all the pixels of the 
output display device. Each pixel includes sub-pixels each defining a color component 
and a sub-pixel position associated with a given pixel. The method includes displaying a 
plurality of regions, one for each possible sub-pixel geometry, each region including a 
pattern that is susceptible to color fringing depending on the sub-pixel geometry for the 
output display device, and prompting a user to select a region. Displaying for each of the 
pixels a selected visual output intensity relative to the output display device at a sub-pixel 
position according to a corresponding pixel input value will cause an optimal display of 
fine structure images to be displayed on the output display device. 

In another aspect, the invention provides a method for determining a set of 
device-specific pixel input values that will cause the display system to display a 
corresponding set of target output intensities relative to a liquid crystal display (LCD) 
device. The invention further includes providing a method for determining a device- 
specific sub-pixel geometry for all the pixels of the liquid crystal display (LCD) device. 
Displaying for each of the pixels a selected visual output intensity relative to the liquid 
crystal display (LCD) device at a sub-pixel position according to a corresponding pixel 
input value will cause an optimal display of fine structure images to be displayed on the 



liquid crystal display (LCD) device. 

Advantages that can be seen in implementations of the invention include one 
or more of the following. A user can determine a set of device-specific pixel input values 
that will cause a display system to display a corresponding set of target visual output 
intensities relative to the output display device such that fine structure monochrome 
images displayed appear to the user to be optimal for the output display device. A user 
can select a device-specific sub-pixel geometry for all pixels of the output display device 
where each pixel includes a plurality of sub-pixels each defining a color component and a 
sub-pixel position associated with a given pixel such that color fringing is minimized.. 

Another advantage is the method is intuitive for the user and can be 
accomplished quickly and accurately with little required knowledge of the underlying 
technology or device. Among the situations where this might be used would be 
presentation situations where the method is used to calibrate a display system in a 
conference room or large gathering display system. 

The details of one or more embodiments of the invention are set forth in the 
accompanying drawings and the description below. Other features and advantages of the 
invention will become apparent from the description, the drawings, and the claims. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a flow diagram of a process for determining a set of device-specific 
pixel input values that will cause a display system to display a corresponding set of target 
visual output intensities relative to an output display device. 

FIG. 2 is a flow diagram of a process for determining a device-specific sub- 
pixel geometry for all pixels of the output display device. 

FIG. 3 shows a 24-bit data representation of a pixel in a RGB color space 
including 3 sub-pixels: red (R), green (G) and blue (B). 

FIG. 4 illustrates a user interface presented on an output display device 



including a control region and a reference region. 

FIGS. 5a and 5b show reference regions having an average visual output 
intensity at 50%, where a pattern is formed in each reference region. 

FIG. 6 shows every possible ordering of sub-pixels in a RGB output display 

device. 

FIG. 7a shows two adjacent pixels including sub-pixels numbered 1-6 from 
left to right where sub-pixels 3-5 are illuminated. 

FIG. 7b shows two adjacent pixels including sub-pixels numbering 1-6 from 
left to right where sub-pixels 2-4 are illuminated. 

FIG. 8a is a R-G-B sub-pixel geometry test implemented on two adjacent 
pixels in a R-G-B output display device. 

FIG. 8b is a B-G-R sub-pixel geometry test implemented on two adjacent 
pixels in a B-G-R output display device. 

FIG. 9 shows the result of implementing a B-G-R sub-pixel geometry test on 
two adjacent pixels in a R-G-B output display device. 

FIGS. 10a and 10b show alternate sub-pixel geometries for pixels in RGB 
color space. 

Like reference numbers and designations in the various drawings indicate like 

elements. 

DETAILED DESCRIPTION 
FIG. 1 is a flow diagram of a process 100 for determining a set of 
device-specific pixel input values that will cause a display system to display a 
corresponding set of target visual output intensities relative to an output display device. 

The process 100 first obtains a numeric value defining the size of the set of 
pixel input values for which the corresponding visual output intensities are known (step 
101) for the output display device 400. In one implementation, the user is prompted for 



the numeric value. In another implementation, the process 100 obtains a pre-programmed 
numeric value. The process 100 then obtains a target visual output intensity (step 102). 
In one implementation, the user is prompted for the target visual output intensity. 

The process 100 then establishes a reference region 402 (step 103) defined by 
a plurality of reference pixels in the output display device 400, as shown in FIG. 4. The 
process 100 selects a pixel input value for each of the reference pixels from among a set 
of pixel input values for which the corresponding visual output intensities relative to the 
output display device 400 are known (step 104) such that the average of the visual output 
intensities of the reference pixels is the target visual output intensity. The pixel input - 
values are selected such that no perceived patterns such as lines (FIG. 5a) or blocks (FIG. 
5b) are formed in the reference region 402 which can distract the user. Problems 
associated with patterns are less likely to occur when combinations of pixel input values 
that are closer together are mixed. Patterns are also prevalent when the number of pixels 
having a first pixel input value are much greater than the number of pixels having a 
second pixel input value. 

The process 100 then displays the reference region 402 at the target visual 
output intensity with the selected pixel input values for the reference pixels (step 105). 
For example, to achieve a target visual output intensity of 50% red in an output display 
device 400 having RGB color space and a 24-bit data representation of a pixel, the 
process 100 first selects a pixel input value [FF 00 00] for each of a plurality of reference 
pixels such that the red sub-pixel for each pixel has a visual output intensity at 100% 
relative to the output display device 400, and the blue and green sub-pixels have a visual 
output intensity at 0% relative to the output display device 400. The process 100 then 
selects a second pixel input value [00 00 00] for each of the remaining reference pixels in 
the reference region 402 such that all the sub-pixels for each pixel have a visual output 
intensity at 0% relative to the output display device 400. The displayed reference region 
402 has the target visual output intensity of 50% red. 



Once the reference region 402 is displayed, the process 100 displays a control 
region 401 defined by a plurality of control pixels (step 106) on the output display device 
400. As shown in FIG. 4 5 the reference region 402 can enclose the control region 401, or 
can be displayed in close proximity to the control region, e.g., side by side. The reference 
region 402 should be sized large enough to insure the user's focus is able to be 
maintained on the reference region 402 while adjustments to the common pixel input 
value of the control pixels are made (described further below). The user must be able to 
view both the control region 401 and the reference region 402 at the same time without 
having to shift the eye's focus much, if at all. 

The size of the control region 401, as viewed on the output device display 
400, is determined by human interaction. The control region 401 should be large enough 
to be easily and comfortably viewed by the user, but not so large as to dominate the 
output device display 400. In one implementation, the ratio of the size of the control 
region 401 to the reference region 402 is 1 :4. Other ratios can be used, however the size 
of the control region 401 should not exceed the size of the reference region 402 or less 
than ideal results may be achieved. 

Each of the control pixels has a common pixel input value. The process 100 
prompts the user to adjust the common pixel input value (step 107). In one 
implementation, the user can adjust the common pixel input value using a slider bar on 
the user interface to vary the common pixel input value over a specified range. In the 
example above, for the output display device 400 having RGB color space, the user can 
adjust the common pixel input value to vary between [00 00 00] and [FF 00 00] to 
achieve a visual output intensity for the control region 401 varying between 0% red and 
100% red. Once the user indicates a match between the appearance of the reference 
region 402 and the appearance of the control region 401 (step 108), the process 100 
associates the user-selected common pixel input value with the target visual output 
intensity (step 109) and the association is stored in the process's memory for use in future 
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applications. 

At this stage of processing, the process 100 determines if the set of pixel input 
values for which the corresponding visual output intensities are known is complete (step 
1 10) , as specified by the size of the set of pixel input values defined in step 101 . If the 
set of pixel input values is complete, the process 100 is complete (step 111). If not, the 
process 100 undergoes an iterative process continuing at step 102 until the set of pixel 
input values is determined to be complete. 

In one implementation, a curve may be fit to the pixel input values for which 
corresponding visual output intensities are known to produce a function that describes the 
relationship between the pixel input value and the corresponding visual output intensity 
over the entire range of visual output intensities, after which, the set of pixel input values 
can be discarded. 

In another implementation, if the target visual output intensity of the reference 
region 402 cannot be obtained exactly from a combination of known pixel input values, 
the process 1 00 may undergo an iterative process to obtain target visual output intensities 
of the reference region 402 close to the target visual output intensity until either the target 
visual output intensity can be reproduced, or the user determines that the displayed visual 
output intensity is visually equivalent to the target visual output intensity. 

In another implementation, the process 100 may establish a control region 401 
and a reference region 402 for each color plane of the output display device 400, and 
prompt the user to adjust the common pixel input value to achieve a match between the 
appearance of the reference region 402 and the appearance of the control region 401 for 
each color plane. 

FIG. 2 is a flow diagram of a process 200 for determining a device-specific 
sub-pixel geometry for all pixels of the output display device 400. The sub-pixel 
geometry information is derived such that an optimal display of fine structure 
monochrome images is displayed on the output display device 400. 



The process 200 first determines the number of sub-pixel geometries that are 
possible for a particular output display device 400 (step 201). The number of possible 
sub-pixel geometries depends on the number of sub-pixels per pixel in the output display 
device 400. For example, if the output display device 400 is constructed using the RGB 
color space, there are 6 (3 sub-pixels; 3!=6) possible sub-pixel geometries, as shown in 
FIG. 6. Whereas if the color space is CMYK, there are 24 (4 sub-pixels; 4!=24) possible 
sub-pixel geometries. 

The process 200 then displays a plurality of regions, one for each possible 
sub-pixel geometry (step 202). Each region displayed by the process 200 includes a 
pattern that is susceptible to color fringing depending on the sub-pixel geometry of the 
output display device. In one implementation, used when evaluating an output display 
device 400 is constructed using the RGB color space, the pixels may comprise vertical 
rectangular color bars (sub-pixels) that form a square-shaped pixel. Each region 
displayed includes a pattern. In one implementation, the pattern comprises a series of 
single pixel-wide vertical lines separated from the next vertical line by a plurality of 
pixels. In one implementation, the vertical lines are white and displayed on a black 
background. A single pixel-wide vertical line is produced with no color fringing by 
setting adjacent sub-pixels distributed over 2 adjacent pixels to have visual output 
intensities of 100%. Illuminating a sub-pixel is defined by setting a sub-pixel to have a 
visual output intensity of 100%. 

When evaluating an output display device 400 constructed using the RGB 
color space that has an unknown sub-pixel geometry, different test patterns are tested on 
different displayed regions. Implementing each test pattern available for an output 
display device 400 will result in the illumination of different color sub-pixels to form the 
single pixel-wide vertical lines. FIGS. 7a and 7b show a X-Y-Z test pattern implemented 
on an output display device having a X-Y-Z ordered sub-pixel geometry. The test pattern 
for an XYZ orientation region is produced as follows: 
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First sub-region> 

pixel M: sub-pixel 3 (Z) is illuminated 

pixel N: sub-pixels 4 (X) and 5 (Y) are illuminated 
Second sub-region> 

pixel M: sub-pixels 2 (Y) and 3 (Z) are illuminated 

pixel N: sub-pixel 4 (X) is illuminated. 

For example, a R-G-B test pattern is implemented in a region on an output 
display device having a R-G-B ordered sub-pixel geometry, by illuminating the sub- 
pixels as shown in FIG. 8a. The vertical lines displayed in both sub-regions of this region 
will appear without color fringing. Similarly, a B-G-R test pattern is implemented in a 
region on an output display device having a B-G-R ordered sub-pixel geometry, by 
illuminating the sub-pixels as shown in FIG. 8b. The vertical lines displayed in both sub- 
regions of this region will appear without color fringing. The test patterns for other 
output display devices having differently ordered sub-pixel geometries are produced in a 
similar fashion. 

When the sub-pixel geometry of the output display device does not match the 
test pattern being implemented, color fringing is readily visible. For example, for an 
output display device having a R-G-B ordered sub-pixel geometry, implementing the 
R-G-B test would result in solid white vertical lines being formed (illuminating the B 
sub-pixel in pixel M, and the RG sub-pixels in pixel N for one sub-region, and 
illuminating the GB sub-pixels in pixel M and the R sub-pixel in pixel N for the other 
sub-region, both result in the 3 adjacent illuminated sub-pixels that form a white pixel). 
However, implementing the B-G-R test on the same output display device (illuminating 
the R sub-pixel in pixel M and illuminating the BG sub-pixels in pixel N in one sub- 
region, while illuminating the GR sub-pixels in pixel M and illuminating the B sub-pixel 
in pixel N in the other sub-region) would result in red, cyan, yellow and blue fringing 
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effects at the edges of the white lines displayed therein. 

FIG. 9 illustrates why the color fringing effects are visible when the B-G-R 
test is implemented on an output display device having a R-G-B ordered sub-pixel 
geometry. In one sub-region, the illuminated R sub-pixel in pixel M is separated from the 
illuminated GB sub-pixels in pixel N by 3 non-illuminated sub-pixels. Similarly in the 
other sub-region, the illuminated RG sub-pixels in pixel M are separated from the 
illuminated B sub-pixel in pixel N by 3 non-illuminated sub-pixels. When the R, G and 
B illuminated sub-pixels are not adjacent to each other, they form a white pixel with color 
fringing. 

In one implementation, the different regions are displayed simultaneously. 
Alternatively, the different regions can be displayed individually, and the user can toggle 
between the regions prior to selecting a region. The process 200 prompts the user to 
select a displayed region by toggling a button on the user interface in step 203. In one 
implementation, the process 200 prompts the user to select the displayed region with the 
least color fringing. Once the user has selected a displayed region, the process 200 
assigns the ordering of the sub-pixel geometry test implemented on the selected displayed 
region to be the device-specific sub-pixel geometry (step 204) and the process ends. 

Alternatively, the process 200 prompts the user to select the displayed region 
with the most color fringing. Once the user has selected a displayed region, the process 
200 assigns the complement ordering of the sub-pixel geometry test implemented on the 
selected displayed region to be the device-specific sub-pixel geometry (step 204) and the 
process ends. For example, if the R-G-B test is the test implemented on the displayed 
region selected to have the most color fringing, the process 200 assigns the B-G-R 
sub-pixel geometry to be the device-specific sub-pixel geometry. 

In another implementation in RGB color space, the region displayed includes 
a pattern comprising single pixel-wide intersecting diagonal lines where the diagonal 
lines are formed by white pixels each distributed over 2 pixels. On some output devices 
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and/or under particular lighting conditions, color fringing is more visible at diagonal 
intersections. 

Other types of sub-pixel geometries are possible. For example, instead of 
sub-pixels arranged as a series of vertical color bars, an output device can include 
sub-pixels arranged in a different geometry, such as horizontal color bars. Other pixel 
geometries are also possible (non-square) as is shown in FIGS. 10a and 10b. For each 
type of sub-pixel geometry, the process 200 displays a series of test patterns to determine 
the ordering of the sub-pixels. 

The invention can be implemented in digital electronic circuitry, or in 
computer hardware, firmware, software, or in combinations of them. Apparatus of the 
invention can be implemented in a computer program product tangibly embodied in a 
machine-readable storage device for execution by a programmable processor; and method 
steps of the invention can be performed by a programmable processor executing a 
program of instructions to perform functions of the invention by operating on input data 
and generating output. The invention can be implemented advantageously in one or more 
computer programs that are executable on a programmable system including at least one 
programmable processor coupled to receive data and instructions from, and to transmit 
data and instructions to, a data storage system, at least one input device, and at least one 
output device. Each computer program can be implemented in a high-level procedural or 
object-oriented programming language, or in assembly or machine language if desired; 
and in any case, the language can be a compiled or interpreted language. Suitable 
processors include, by way of example, both general and special purpose 
microprocessors. Generally, a processor will receive instructions and data from a 
read-only memory and/or a random access memory. Generally, a computer will include 
one or more mass storage devices for storing data files; such devices include magnetic 
disks, such as internal hard disks and removable disks; magneto-optical disks; and optical 
disks. Storage devices suitable for tangibly embodying computer program instructions 
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and data include all forms of non-volatile memory, including by way of example 
semiconductor memory devices, such as EPROM, EEPROM, and flash memory devices; 
magnetic disks such as internal hard disks and removable disks; magneto-optical disks; 
and CD-ROM disks. Any of the foregoing can be supplemented by, or incorporated in, 
ASICs (application-specific integrated circuits). 

To provide for interaction with a user, the invention can be implemented on a 
computer system having a display device such as a monitor or LCD screen for displaying 
information to the user and a keyboard and a pointing device such as a mouse or a 
trackball by which the user can provide input to the computer system. The computer 
system can be programmed to provide a graphical user interface through which computer 
programs interact with users. 

The invention has been described in terms of particular embodiments. Other 
embodiments are within the scope of the following claims. For example, the steps of the 
invention can be performed in a different order and still achieve desirable results. 

What is claimed is: 
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